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ABS'l'KACT.  riie  sum.  dilTcience.  product  and  (luolicnl  ol  two  rimclioiis  with  dilTeienl 
domains  are  usually  delined  t)nly  t)ii  Ihcir  eomnuin  domain.  I'his  paper  e.xleiuls  these 
delinilions  so  that  the  sum  and  other  operations  are  cssettlially  dclincd  anywhere  that  at 
least  one  of  the  eomponenls  is  delined.  This  idea  is  applied  to  propositions  and  events,  ex- 
[pressed  as  indicator  functions,  to  deline  comlitiomil  propositions  and  condiiioiuii  events  as 
ihrce-valiicd  indicator  functions  that  aic  undclincd  when  their  condition  is  fal.se.  Lxtended 
operations  of  “and'\  “or",  “not”  and  “coiulitii>ning”  are  then  defined  on  these  conditional 
events  with  variable  conditions.  The  probabilities  of  the  disjunction  (or)  and  of  the  con¬ 
junction  (and)  of  lw(i  conditionals  are  ex|)rcssed  in  terms  of  the  conditional  probabilities  of 
the  component  conditionals.  In  a  special  ease,  these  arc  shou  n  to  he  weighted  averages  of 
the  component  condilional  probabilities  uhere  the  weights  arc  the  relative  probabilities  of 
the  various  conditions.  Next,  ct)nditional  random  variables  arc  delined  to  be  random  vari¬ 
ables  A'  whose  domain  has  been  restricted  by  a  condition  on  a  second  random  variable  1  . 
1'he  extended  sum,  difference,  product  and  conditioning  operations  on  functions  are  then 
applied  to  these  conditional  random  variables.  T  he  expectation  of  a  random  variable  and 
the  condilional  expectation  of  a  conditional  random  variable  arc  recounted,  d'lieorem  1 
generalizes  the  standard  result  that  the  condilional  expectation  of  the  sum  of  two  con¬ 
ditional  random  variables  with  disjoint  and  exhaustive  conditions  is  a  weighted  sum  of 
the  condilional  expectations  of  the  component  conditional  random  variables.  Because  of 
the  extended  opeialions,  the  theorem  is  true  for  aibilrary  conditions.  Theorem  2  gives 
a  formula  for  the  expectation  of  the  product  of  two  condilional  random  variables,  After 
the  definition  of  independence  of  two  random  var  iables  is  extended  to  accommodate  the 
extended  opeialions.  it  is  applied  to  the  formula  of 'riieoiem  2  to  simplify  the  cxpeclatimi  of 
a  product  of  condilional  random  var  iables.  Two  examples  end  the  paper  .  TUc  lirst  cortcerns 
a  work  force  of  n  wor  kers  of  dilTererU  output  levels  and  wor  k  shifts.  'I  hc  secorKl  example 
involves  two  radars  with  overlapping  surveillance  regions  and  different  detection  error 
rales.  One  radar’s  error  rate  is  assumed  It)  be  sensitive  to  fog  and  the  other  radar  s  er  ror  rate 
is  assumed  it)  be  sensitive  U)  air  traffic  density.  The  ct)mbined  cnt)r  I'alc  over  the  cornbineil 
surveillance  iegit)n  given  heavy  fog  and  mt)dcrate  air*  traffic  is  computed. 

KT.Y  WORDS:  ct)ndilionaL  contlititinal  expcclalit)n.  domain,  functions,  operations,  ran¬ 
dom  variable,  three-valued 
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1.  Introduction 


From  elemenlary  malhematics,  we  are  all  familiar  with  the  definitions 
of  the  operations  of  addition,  subtraction,  multiplication,  and  division  for 
real-valued  functions  delined  on  a  common  domain  D.  For  each  domain 
element  .v,  the  sum  fiinction,  (/  +  is  simply  assigned  the  value  (/  + 
i^)(.v:)  =  f(x)  +  the  sum  of  the  values  of  /  and  g  at  .v,  and  similarly 
for  the  other  operations.  However,  function  division,  requires  an 

extra  condition,  namely  that  ^^(.v)  not  be  zero,  so  that  the  division  can  be 
performed.  So  if/^)  is  said  to  he  ‘Tindelined”  for  any  domain  values  .v 
for  which  =  0.  Thus  already  the  division  operation  on  functions 

generates  new  functions  that  have  restricted  domains,  and  in  general  such 
divisions  will  generate  functions  having  different  domains  of  definition. 
This  leads  to  the  standard  delinition  of  operations  on  funetions  whose 
domains  are  different:  If  f  and  ^  are  defined  on  D  and  E  respectively, 
then  the  sum  function  (/  +  is  defined  on  the  intersection  of  I)  and  E  as 
follows: 


(1) 


(f  +  ^){x)  = 


I  (a')  T  if  A'  ^  /T  n  Zl, 

Undefined  if  a  ^  D  n  E. 


The  difference,  product  and  division  runctions  /  —  f  *  g,  and  f/g  are 
similarly  defined  when  D  and  E  are  the  domains  of  /  and  g  respectively, 
but  again  the  quotient  (//g)  is  also  undefined  on  any  zeros  of  Since 
a  summing  of  /  and  ^  cannot  be  performed  for  a  given  domain  value  .v 
unless  both  /  and  g  are  defined  at  at  this  has  seemed  to  be  a  reasonable 
definition,  and  there  has  been  no  reason  offered  to  do  it  in  any  other  way. 


2.  Extbndit)  Operations  Sum,  Dii  i  lrench  and  Product 
ON  Rbaf.- Valued  Functions 


However,  recent  developments  in  conditional  event  algebra  12,  5]  suggest 
that  there  is  good  rea.son  for  expanding  the  domain  of  the  sum  function  to 
include  all  values  of  a  that  are  in  at  least  one  of  the  two  domains.  Using 
the  set  theory  notation  D'  to  deuene  the  complement  of  D,  the  definition  of 
the  sum  function  (/  +  g)  can  advantageously  be  extended  to: 


(2)  (/Tg)(A-) 


/(AO-Fg(A-)  if  A'  €  DHE, 

/(a)  if.v  €  DDE', 

g(A)  if  A'  ^  D'n  /:, 

Undefined  if.v:  6  D'  fl  E\ 


In  other  words,  here  the  sum  function  takes  the  value  ol  /(a)  irg(A)  is 
undefined,  and  takes  the  value  g(A)  if  /(a)  is  undefined.  It  then  agrees 
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with  the  old  dclinitiun  on  the  reslriclcd  domain  D  H  E  and  is  undclincd 
only  on  the  region  outside  of  D  U  E,  The  other  operations  on  functions, 
(/  ~  (7*^0  i^nd  if  /g)  can  be  similarly  delined.  The  product  {f  is 

completely  analogous  to  the  sum  with  *  in  place  of  +.  The  dilTcrenee  is; 


(3)  {f-g){x) 


f{x)-g{A)  if.v  e  Df^E. 

fix)  if.v  e  nr\  E\ 

-g{x)  if..v  6  I)' HE. 

Undelined  if.v  G  D'  H  E\ 


The  quotient  is  analogous  to  the  difference: 


(4) 


(f/g)ix)  = 


f(x)/g{x)  if  .v  e  l)r\E  and  g(x)  ^  0, 
fix)  if.v  e  on  E\ 

l/^'(.v)  if  V  G  D'  n  E  and  ,sT-v)  /  0, 

Undclincd  if.v  G  If  Pi  Ef  oi\i,'(-v)  0. 


Note  that  although  it  is  possible  in  the  sum  case,  for  example,  to  rcdelinc 
the  two  functions  /  and  g  to  be  zero  instead  of  undclincd  and  thereby 
eliminate  the  need  for  the  extended  operations,  a  subsequent  desire  to  take 
the  product  instead  of  the  sum  would  require  another  rcdelinition.  Other 
advantages  are  exhibited  below. 


3.  PROPOSt  rtONS,  HviiNTS  AND  INDICATOR  FUNCI'IONS 

These  kinds  of  extended  dclinitions  have  been  shown  |2,  4,  5|  to  be  useful 
when  delining  Boolean-like  operations  on  uncertain  conditional  proposi¬ 
tions  or  conditional  events  whose  conditions  arc  dilTercnt. 

In  a  similar  vein  restricted  indicator  functions,  and  their  closure  un¬ 
der  Unite  addition,  have  been  used  successfully  by  Suppes  and  Zanotti 
1 13,  p.  1()|,  or  1 12|  to  deline  a  qualitative  relation  between  paiis  of  events 
characterizing  the  conditional  probabilities  and  conditional  expectations  of 
such  pairs  of  events  and  allowing  comparison  of  conditional  probabilities 
or  conditional  expectations  even  when  the  conditions  on  the  events  are 
dilTercnt. 

For  Boolean  propositions  or  events  /\  and  B  we  have  familiar  and  stan 
dard  operations  of  “aiuf’  (a),  “or  *  (V),  and  “not"  (-^)  corresponding  to 
multiplication  (*),  summation  (+),  and  negation  (— )  respectively,  and  also 
corresponding  to  intersection  (D),  union  (U),  and  complement  (')  in  the 
event  intcipretation.  There  has  been  no  standard  dermition  of  division  of 
propositions  or  events  but  now  “conditicaiing"  has  been  recognized  to  be 
division.  See,  for  instance,  [61. 
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A  proposition  A  can  be  represeniccl  as  a  measurable  indicator  function 
J\/[  delined  on  the  universe  Q  and  taking  the  value  I  lor  m  e  A  and  0  for 
ru  G  /t': 


(5)  jAio>) 


I ,  (O  E.  /\ , 

0,  (0  e  /V. 


With  this  representation,  the  standard  operations  on  propositions  or  events 
can  be  expressed  in  terms  of  function  operations.  For  instance  the  nega¬ 
tion  (')  of  an  event  A,  which  is  simply  the  function  that  is  0  on  /\  and  I 
on  A',  can  be  expressed  as  (/q  —  /a)  the  universal  proposition  minus  [a. 
The  disjunction  (v)  of  two  propositions  Ja  and  defined  respectively  on 
domains  A  and  B  is  the  indicator  function  /avb  defined  by 


(^>)  JavbUo) 


I,  (oe(A\J  B), 
0,  nj  G  (A  U  BY. 


This  disjunction  (V)  of  two  propositions  A  and  B  can  be  expressed  as  the 
maximum  max(/^^,  f)^)  of  the  two  indicator  function  /a,  and  fn.  Similarly 
conjunction  (a)  is  min(/,\,  //;).  For  notational  simplicity,  a  proposition 
/a  vvill  be  denoted  simply  as  “4”  but  will  retain  the  indicator  function 
meaning. 

The  probability  /^./a)  a  proposition  or  event  /a  is  delined  to  be 
B(A),  the  probability  of  the  /^-measurable  event  A  on  which  /  takes  the 
value  I.  So  r(f\)  =  />(/a  =  I)  =  /’(./7'(l))  =  e  = 

II). 


4.  CONDITIONAI.  PROPOSITIONS,  HVENTS  AND  RESTRICTED 

INDK’ATOK  Functions 

Fallowing  De  Finctti  [8|  a  conditional  (A|/J),  given  //”  or  ‘V\  if  B'\  is 
an  ordered  pair  of  propositions  or  events  with  three  possible  truth  states: 
(A\B)  takes  the  truth  value  of  /\  when  B  is  true  hut  (A|//)  is  ‘Tindelined” 
or  “inapplicable”  when  B  is  false.  That  i.s, 

f  true  if  A  and  B  are  true, 

(7)  (A|//)  is  I  false  if  A  is  false  and  B  is  true, 

I  Undefined  if  B  i.s  false. 

While  De  Finetti’s  3-valuedness  for  conditionals  is  followed,  the  inlerpre- 
(ation  here  of  the  third  truth  value  as  “undclined”  or  '‘inapplicable”  differs 
markedly  from  that  of  De  Finetli,  who  interprets  the  third  truth  value  as 
“unknown”  and  so  therefore  as  something  similar  or  equivalent  to  a  prob¬ 
ability  value  between  0  (false)  and  1  (true).  By  contrast  the  “inapplicable” 
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interpretation  is  not  a  truth  or  falsity  value;  it  is  an  iiulicator  of  irrelevance. 
This  crucial  difference  in  interpretation  leads  to  a  difference  in  operations. 

A  conditional  can  be  represented  as  a  restricted  (partially  dclined)  indi¬ 
cator  function,  (A\B): 


[  1  \((o  e  AD  IL 

(A|/i)(f/;)  =  I  0  if  a;  G  A'  Pi  B. 

I  Undclined  if  (o  €  B' 

.ON  _  A{(o)  if  (0  G  /T 

Undelincd  if  co  ^  B. 

Since  B{(o)  =  1  if  a;  G  /T  the  latter  ean  be  expressed  as 


(9) 


{A\B)((o)  = 


A{a)}  A  B{(o)  \\'(o  G  /T 

Undefined  if  a)  ^  B. 


So  (/\|/i)  is  just  the  indicator  function  (A  A  /O  restricted  to  the  instances 
(0  G  B. 

For  any  conditional  (A|/^)  with  P(B)  ^  0,  the  conditional  probability 
B(A\B)  is  defined  as  usual  to  be  F(A  A  B)/ P{B).  With  this  definition, 
the  conditionals  (A|/^)  have  conditional  i)robabililics  that  also  satisfy  the 
6  qualitative  axioms  of  Suppes  and  Zanotti  [12)  or  [13]  for  a  conditional 
probability  measure. 


3.  Fxi'i^nded  Operations  on  Conditional  Propositions 

We  can  expand  the  definition  of  a  conditional  to  inelude  cases  in  which 
A  anti  B  themselves  are  conditionals.  To  do  this  we  need  onh  decide  on 
the  definition  of  a  conditional  whose  premise  is  undelincd  ((/).  the  other 
cases  being  already  determined.  We  will  interpret  an  undefined  condition 
to  mean  that  there  is  no  additional  restriction  imposed  by  it: 

l(A|/i)  I  (Cl/3)|(oA  =  \{A\B){o))  \  {C\I)){a))\ 

\(A\B)i(o)  \\(C\l))((o)^{). 

[  IJndehned  if  {C\l)){a))  —  0 

^  {A\B){a))  WcoeCvir. 

.  Undclined  ifa^  ^  (  V  iP 

^  j  A  ifa;G  B  A  (Cv  IP), 

\  Undclined  ifo;  i  B  a  (C  v  /)'). 

So 


(II)  (A|/i)  I  {C\n)  =  (A  1  BiC  V  //)). 
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With  the  definilion  of  a  conditional  event,  and  using  the  extended  defini¬ 
tions  of  the  operations  on  functions,  definitions  can  be  developed  for  dis¬ 
junction  (V),  eonjunction  (A)  and  negation  (')  to  go  along  with  division  (|) 
as  follows.  (Also  see  |4]). 

\(A\B)  V  iC\D)\i(o)  =  {A\B)(a))  v  (C\D)((o) 

(\2)  =  ^  ^  ^  ^  ^ 

Undefined  if  a  ^  B  U  D. 

The  latter  expression  is  just  the  eonditional  ((/i  A /?)  v  (C  A  D)  |  (Bv  D)), 
So 


(13)  (A|/i)v(C|D)  =  ((/\/ivCD)  I  (Bv  D)). 


Here,  juxlaposition  of  events  A  and  has  replaeed  the  conjunction  nota¬ 
tion  A  A  /?.  (A\B)  V  (C|/))  is  just  (AB  v  CD)  restricted  to  (B  v  D). 

For  example,  eonsider  the  experiment  of  rolling  an  ordinary  6-sided  die 
once,  and  observing  the  number  n  showing  up  on  the  die.  Suppose  a  wager 
is  made  that  “if  ii  is  even  then  it  will  be  a  2,  or  if  n  <  5  then  ii  <  4”. 
Finch  of  the  two  component  conditionals  is  applicable  on  a  different  subset 
of  outcomes  of  the  die  roll,  and  combining  them  with  “or”  results  in  a 
disjunction  of  two  conditional  propositions. 

By  using  (13)  this  disjunction  is  equivalent  to  a  single  conditional,  with 
a  conditional  probability:  (n  =  2  \  n  is  even)  V  (/i  <  4  |  <  5)  = 

((//  =  2)  V  (n  <  4)  I  (n  ^  5))  =  ({ 1, 2,  3}  |  ( 1, 2,  3,  4,  6}),  which  is  the 
conditional  event  that  if  the  roll  is  not  5  then  it  will  be  1,2  or  3.  This  has 
conditional  probability  3/5.  By  brute  force  examination  of  the  6  outcomes, 
this  result  ean  be  seen  to  be  eonsisteni  with  intuition:  Only  a  non-5  is 
applicable  to  at  least  one  of  the  two  component  conditionals.  So  a  “5” 
roll  doesn’t  count.  Given  a  non-5  roll  the  set  ( 1 , 2,  3}  corresponds  to  win¬ 
ning  the  wager  since  “1”  and  “3”  satisfy  the  second  component  while  “2” 
satisfies  the  first  component,  but  “4”  and  “6”  satisfy  neither  component. 

Similarly,  for  conjunction  (a) 


\{A\B)  a(C\D)\((o) 


=  (A\B)((o)a{C\D)[(o) 


{ABCD)((o) 

{AB)((o) 

(CD)  (CO) 

Undelined 


(oe  BD  /), 
m  6  B  n 
CO  e  B'  n  /), 
w  €  B'  n  /r 


(/\  BCD)i(o) 
{ABD')i(o) 
(B'CD)((o) 
Undefined 


f  r/j  G  B  n  /), 
\‘(o  e  BD  /y, 
f  G  B'  n  D, 
^coe  B'n  D' 
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(14) 


{ABCD  V  ABiy  A  By'D){o))  if  .v  €  /i  U  /), 


Undelined 


if.v  i  B\J  /). 


So 


(15)  {A\B)  A  {C\D)  =:  {ABCD  v  ABD’  v  B'CD)  \  (B  v  /)). 

1’lic  negation  operation  is  f(A|/?)'|(r^;)  =  [(/\|/i)(a))r  =  /\'(fn)  if  o;  €  />. 
or  undelined  if  a>  G  B' .  So 

(16)  {A\By  =  {A'\B). 

This  algebra  of  uncertain  conditional  events  or  propositions  has  been  ex¬ 
tensively  developed  in  [2-7|  ineliiding  a  theory  of  deduetion  for  uncertain 
conditionals  extending  Boolean  deduction.  See  [2.  p.  227]  for  an  account 
of  the  Boolean  properties  retained  and  lost  in  the  algebra  of  conditionals. 

Concerning  the  structure  of  this  algebra  of  eonditionals,  the  conjunction 
and  disjunction  operations  are  obviously  coininutativc  and  idenipotent. 
1  hey  are  less  obviously  also  associative.  The  inapplicable  conditional  ( 1 1()) 
is  the  unique  absolute  unit  sinee  for  all  eonditionals  ix\y),  (a  |y)  A  ( 1 1())  — 
(a|>')  and  {x\y)  v  (1|0)  —  {x\y).  While  there  is  a  uniciue  relative  com¬ 
plement  {a'\h)  for  each  conditional  ((i\h)  such  that  {a\h)  V  {a'\h)  —  (()|/;) 
and  (r/|/;)  A  ia'\h)  —  (M/?),  there  are  no  absolute  complements.  Although 
(.v|3’)  A  0  =  0  and  (a|  v)  v  1  =  K  it  is  also  true  that  (a|v)  A  1  =  av 
and  (A|y)  V  0  =  .vv.  Neither  distributive  law  holds  in  general.  However, 
conjunction  distributes  over  disjunetion  if  and  only  if  whenever  the  out¬ 
side  conditional  is  true  and  one  of  the  inside  eonditionals  is  false,  then 
the  other  inside  eonditional  is  applicable.  Similarly,  disjunction  distributes 
over  eonjunction  if  and  only  if  whenever  the  outside  eonditional  is  false 
and  one  of  the  inside  conditionals  is  true  then  the  other  inside  conditional 
is  applicable.  (A  proof  of  these  facts  about  distributivily  will  be  provided 
in  a  subsequent  paper.) 


6.  Whighti  i)  Avi:raoi:s 


Among  the  interesting  properties  of  these  operations  are  the  I'ollovving 
weighted  average  formulas  ([5,  p.  16821)  ior  the  probabilities  of  the  com¬ 
pound  conditionals  of  Equations  (13)  and  (15): 


r{{A\B)y{C\D)) 

=  P{B  I  B  V  n)P{A\B) 


-yP{I)  I  B  V  D)P{C\D)  PiABCD  |  B  v  /)). 


(17) 
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Pi{A\B)  A{C\i))) 

=  P{B  I  B  V  D)P{Aiy\B) 

(18)  +P{D  I  B  V  l))P{CB'\D)  +  PiABCD  \  B  V  D). 

7 he  Iasi  icmiol  (  17)  and  (18)  can  be  written  as  P(BD  \  Bv D)  P{AC\B D), 

ir  the  truth  ol' each  conditional  implies  the  inapplicability  of  the  other 
conditional,  that  is  if  A  B  is  a  subset  of  ly  and  C  D  is  a  subset  of  B\  as  for 
example  when  the  two  conditions,  I)  and  D,  are  disjoint,  then  both  (17) 
and  ( 18) reduce  to: 

/^((/\|/1)  v(C|/^)) 

=  P(iA\B)A(C\D)) 

(19)  ==  PiB  I  B  V  n)P{A\B)  +  P(I)  I  B  V  D)P{C\l)). 

In  any  case,  without  any  extra  assumptions  the  following  logical  equation 
always  holds: 

(20)  (/\|/0  V  (C\l))  =  (B  1  B  V  f)){A\n)  V  (/)  I  V  D){C\D). 

The  right-hand  side  of  ( 19)  is  a  weighted  average  of  the  conditional  prob¬ 
abilities  of  (/\|/i)  and  (C\D)  where  the  weights  are  the  probabilities  of  B 
and  of  D  given  either  occurs.  Because  the  conditional  expectation  of  a  rc- 
stricted  indicator  function  of  an  event  A  equals  the  conditional  probability 
of  A  given  the  restriction  />,  this  formula  is  equivalent  to  the  one  displayed 
by  wSuppes  and  Zanotii  1 12,  p,  165]  or  1 13,  p,  13]  for  the  expectation  of  the 
disjunction  of  restricted  indicator  functions. 

Note  that  because  it  is  a  weighted  average  the  right-hand  side  of  (19) 
will  in  general  lie  between  P{A\B)  and  P(C\D)  not  above  both,  vSo  dis¬ 
junction  of  conditional  events  is  not  always  monotonic;  /^((/A  |  T?)  v  (Cj  D)) 
can  be  lc,ss  than  /^(/\|/)*).  Similarly  P(iA\B)  a  (C\D))  can  be  greater  than 
P(/\|/)’),  This  is  not  strange  because  in  general  disjunction  or  conjunc¬ 
tion  of  a  conditional  {A\B)  with  another  conditional  (C\I))  expands  the 
context  to  (B  v  79),  which  allows  for  greater  or  les,ser  probability  than 
before  the  application  of  the  operation:  If  (C\D)  is  (i)\Q)  then  disjunction 
with  (/\|/)V)  yields  AB,  who,se  generally  lower  probability  than  P{A\B)  is 
P(A\B)PiB).  If  (C|/9)  is  ( 1|^^)  then  disjunction  with  (A\B)  yields  i\\Q), 
with  probability  1 . 

As  a  simple  example  of  this  non-monotonicity,  let  Q  =  {1,2,  3,  4,  5,  6), 
the  numbered  faces  of  a  6-sided  die  thrown  once,  and  let  B  =  {2,  4,  6}  and 
/\  =  (2,4],  The  conditional  probability  of  rolling  2  or  4,  given  the  roll 
is  an  even  number,  equals  2/3,  That  is,  P(A\B)  =  2/3.  Now  suppose 
also  that  C  =  !!}  and  /)  =  {1,3,5},  So  P(C\I))  =  1/3,  That  is  the 
probability  of  rolling  a  1,  given  the  roll  is  an  odd  number,  equals  1  /3,  Now 
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what  is  the  piobabilily  of  “rolling  a  2  or  4  given  the  roll  is  even,  or  rolling 
1  given  the  roll  is  ockf’?  Thai  is,  /^((/\|/i)  V  (C\D))  —  7  The  answer  is 
P{AB  V  CD  I  B  V  D)  =  P{l,2,4}//'{even  orodd)  =  3/6  =  1/2.  So 
here  B({A\B)  v  (C|D))  is  less  than  P(A\B)  alone. 


7.  EXTliNDi:D  OPHRATIONS  ON  RANDOM  VaRIAIU.FS 

I  laving  extended  the  operations  for  fuiiclions  with  different  domains  and 
having  applied  them  to  extend  the  oiierations  for  conditional  propositions, 
it  is  possible  to  extend  the  operations  on  random  variables  and  conditional 
random  variables.  A  real-valued  random  variable  A'  is  a  function  from  a 
sample  space  Q  of  a  probability  space  {Q.  33,  P)  into  the  real  numbers 
such  that  for  any  real  number  a,  the  set  of  instances  co  e  Q  for  which 
X((o)  <  X  is  a  member  of  <S,  and  so  has  a  probability  P\o)  e  : 
A'(co)  <  a}.  It  follows  that  there  is  a  probability  that  A"  takes  a  value  in 
any  of  the  collection  of  Borcl  subsets  of  real  numbers,  consisting  of  those 
subsets  that  arc  a  countable  collection  of  intersections  or  unions  of  the 
intervals  (— oo,  a)  or  their  complements  |a,  oc),  for  any  real  number  a.  Of 
cour.se  any  interval  (a,  y)  of  real  numbers  is  a  Borcl  set. 

As  with  functions,  just  doing  division  on  random  variables  in  general 
produces  new  ones  with  different  domains  whenever  the  divisor  assumes 
the  real  value  0.  Subsequently,  using  standard  tcchniciucs,  operating  with 
this  restricted  variable  will  propagate  its  restricted  domain.  How  ever  using 
these  extended  operations,  the  domains  of  functions  can  be  expanded  as 
well  as  restricted. 

While  the  ordered  pair  (A\B)  for  events  A,  B,  is  defined  and  interpreted 
as  “event  A  given  event  is  true'’,  the  corresponding  construction  (A"|)'), 
where  A"  and  Y  arc  random  variables,  can  not  be  immediately  interpreted 
because  “given  Y  is  true"  does  not  make  sense  for  real-valued  random 
variables.  The  condition  must  be  an  event  such  as  )'  G  B,  the  event  that  Y 
takes  a  value  in  a  Borcl  set  of  real  numbers  B. 


8.  CONDI  i  lONAL  RANDOM  VARIABLES 


Let  A',  K,  W,  Z  be  real-valued  random  variables  on  a  probability  space 
/p  —  {Q,33,  P)  and  let  A,  B,  C,  D,...  be  Borcl  sets  on  the  real  line. 
A  conditional  random  variable  (A"  \  )'  e  B  )  is  just  the  random  variable  V 
restricted  to  the  instances  co  for  which  K(oA  G  B.  That  is. 


I  Kiev) 

\  Undefined 


if  YUo)  G  B, 
if  Yio))  ^  B 


=  A’  on  }'  '(/y). 


(21)  {X\YeB)  = 


iO 
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If  is  empty,  then  (X  |  )'  €  B)  is  completely  undefined,  defined  for 

no  insliinces  co. 

Although  conditional  probability  distributions,  conditional  density  func¬ 
tions  and  conditional  expectations  have  standard  definitions  (See,  for  in¬ 
stance,  [11]),  the  operations  of  siinimation,  difference,  multiplication  and 
division  on  conditional  random  variables  are  all  expressed  in  terms  of  prob¬ 
ability  clistribiilions  rather  than  directly.  But  now  these  can  follow  directly 
from  the  extended  definitions  for  operations  on  functions. 


9.  Ope:rations  on  Conditional  Random  Variables 


Using  the  extended  definitions  for  operations  on  real-valued  functions, 
extended  operations  for  random  variables  can  be  defined  as  follows: 


\{X\Y  eB)  +  {W\ZeD)](a>) 

=  I  ^  ^ 

^  \  Undefined  if  Y((o)  ^  B  and  Z{(o)  ^  D. 

Replacing  “+”  in  (18)  with  negation  (— ),  or  multiplication  (*)  yields  the 
conesponding  operations  on  the  two  conditional  random  variables.  Divi¬ 
sion  requires  a  separate  formula  due  to  possible  division  by  zero: 


(23) 


\(X\Y  e  B)^(W  I  Z  e  D)l(r..) 


Xico)  ^  W((o)  if  Y{(o)  e  B  or  Z(m)  6  D, 
Undelined  if  Y{(o)  i  B  and  Z{(o)  i  D 


X(o))/Wi(o)  if  Y{(o)  e  B  and  0  Z(m)  6  D, 

X(co)  if  Yico)  €  B  and  Z((o)  ^  D, 

\/W(a))  if  Y((o)  i  B  and  0  Z{(o)  G  D, 

Undefined  if  Y{(o)  ^  B  and  (Z{(o)  =  0 

or  Z(a))  ^  D). 


10.  Expectations  and  Conditional  Expectations 

Tlie  expectation  or  average  E{X)  of  a  random  variable  X  is  defined  to  be 
just  the  sum  of  the  values  of  .V  each  weighted  by  its  probability.  Keep¬ 
ing  to  an  elementary  formulation  for  simplicity  of  exposition,  assume  the 
universe  Q  is  finite  or  countable.  Then 

(24)  FAX)  =  Y^X((o)riw). 
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ir  X  and  W  arc  two  random  variables  dclined  on  Q  Ihen  easih  B{X  4 
W)  =  EiX)  +  EiW). 

By  standard  definitions,  the  conditional  expectation  E{X  \  Y  G  /i). 
where  Y  is  a  random  variable  on  Q  and  B  is  a  Borel  subset  oF  real  numbers, 
is  defined  to  be 

E(X  \  Y  G  B)  =  EiX  on  K  '(/,’)) 

=  I  )■■■'(«)) 

=  Y^X((0)r{a>  A  Y-'(B))/P(r  -'{B)) 

(i)e^ 

(25)  -  |1//^(K  G  />’)!  ^  X{a>)rUo). 

Y {(,))(?.  H 

Note  here  that  if  P(K“*(/i))  =  0,  then  the  conditional  expectation  is  iinde- 
lined.  Otherwise,  E(co  1  Y~^iB))  =  0  for  (o  ^  Y  ^(B)  and 
Pico  I  Y-\B))  =  P(aj)/PY~\B))  form  G  Y  ^(B). 

E(X  I  K  G  /?)  is  just  the  expectation  of  the  random  variable  /V  re¬ 
stricted  to  the  instances  co  for  which  Y {co)  takes  a  value  in  /^  The  individ¬ 
ual  probabilities  of  these  instances  arc  just  normali/cd  by  P(Y  g  B)  so 
that  their  sum  is  1  while  they  maintain  the  same  relative  probabilities  with 
respect  to  each  other  as  before  the  conditioning. 

Now  it  is  well  known  (see,  for  example,  1 1  1,  p.  144J)  that  if  Y~^(B)  and 
Z~\D)  are  disjoint  and  exhaustive  of  Q,  that  is,  Y~\B)  A  Z  \l))  —  (I> 
and  Y  ^{B)  v  Z  *(/4)  =  Q  and  if  X,  K,  W  and  Z  arc  random  variables 
on  ^2,  then 


EiiX  \  Y  e  B)  +  {\V  \  Z  e  L))) 

(26)  ::::r  E{X  \  Y  G  B)PiY  G  B)  T  EiW  I  Z  G  l))P{Z  G  B). 

That  is,  the  expectation  of  the  sum  of  the  conditional  random  variables  is 
the  sum  of  the  conditional  expectations  weighted  by  the  probabilities  of  the 
associated  conditions.  With  the  extended  definitions  of  operations  on  ran¬ 
dom  variables  this  result  can  be  generalized  to  allow  Y'  UB)  and  Z^^iD) 
to  be  arbitrary  events  that  may  overlap  and  also  may  not  be  exhaustive 
of  Q. 

hirst  we  extend  the  result  to  disjoint  events  Y  ^(B)  and  Z  *{/>>)  that 
do  not  necessarily  exhaust  Q. 

LBMMA  b  IfY-^{B)  and  Z  ‘(D)  are  disjoint  events  o/Q,  and  if  X,  Y, 
W  and  Z  are  random  variables  on  Q,  then 


EiiX  I  Y  G  B)  +  iW  I  Z  G  D)) 
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=  E{X  I  V  e  H)  /’( Y  6  li  \  Y  e  Hv  Z  e  D) 

(27)  +  E{W  I  Z  e  D)P{Z  e  B\Y  e  Bw  Z  e  D)). 

Proof.  Tliis  result  follows  by  using  ;i  new  probability  measure  on  just 
the  part  of  inside  (K  6  />’  v  Z  g  D).  So  let  Q  be  the  probability  measure 
defined  by  Q(/\)  =  /^/\  \  Y  e  B  v  Z  e  D)  for  any  event  Z  in  ^7. 
That  Q  is  a  probability  measure  on  {Y  e  B  v  Z  e  D)  is  easy  to  show 
since  it  is  non-negative,  Q{Y  e  B  v  Z  e  D)  =  P{Y  s  /?  v  Z  e  /)  | 
Ye  B  V  Z  e  D)  =  1,  and  finally,  if  A  and  C  arc  disjoint  events  in  ^7, 
then  Q(A  V  C)  =  P{A  w  C  \  Y  e  B  w  Z  e  D)  =  P{A  v  C)/P{Y  e 
BvZ  e  D)  =  iP{A)  -b  P{C})/P{Y  e  Bv  Z  e  D)  =  Q{A)  -b  Q{B). 
In  addition,  the  conditional  expectation  Eq{X  |  K  6  />)  with  respect  to 
Q  of  an  arbitrary  random  variable  X  given  arbitrary  (Y  e  B)  equals  tbe 
conditional  expectation  Ep{X  \  Y  e  B)  with  respect  to  P  because 

Eq{X  I  K  g  i?)  =  X{(o)Q{co  AiY  e  B)  \  Y  e  B) 

=  ^A'(m)Q(mA(K  G  B))/Q(Y  G  B) 

(oeQ. 

=  ^X(m)/>(m  A  (K  G  /f))//^(b  G  /f) 

f/>£  ^2 

(28)  =  EriX  I  b  G  />’). 

So  now  computing 

EpiiX  I  K  G  /n-bOi'  I  Z  G  D)) 

=  Eq{{X  I  )'  G  /f)-bOV  I  Z  G  D)) 

=  E(X  I  Y  G  B)(J{Y  G  B)  +  E{W  |  Z  G  D)Q(Z  e  D) 

=  E{X  1  Y  G  B)P{Y  e  B  \  Y  e  B  V  Z  e  D) 

(29)  -b  E(W  I  Z  G  D)P{Z  e  n  \  Y  e  B  V  Z  e  D). 

That  completes  the  proof  of  Lemma  1 .  □ 

THEORBM  1.  If  X,  Y,  IL  aiul  Z  ore  real-valued  raiidnui  varicdiles  and 
B  and  /)  are  arbitrary  Bore!  sidiset.s  of  retd  uuiid)ers,  then 

E{{X  \  Y  e  B)  +  iW  \  Z  e  I))) 

=  E(X  I  Y  G  B)P(Y  e  B\Y  e  BvZ  e  D) 

-b  E{\\'  I  Z  G  /7)T(Z  e  D  \  Y  e  B  V  Z  e  D). 


(30) 
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rrooj:  Let  K  =  Y-'{B)  =  {w  e  Q  :  Y{(0)  G  B]  and  L  =  Z  '{/)). 
So  using  tlic  definition  of  extended  suninuition  for  conditional  landtnii 
variables. 

EiiX  I  K  G  /i)  +  (VV  I  Z  G  /))) 

=  EiiX  1  K)  +  iW  I  D)  =  EiX  +  VL  I  K  V  /,) 

(31)  =  EiiX  I  KL')  +  (X  +  IV  I  Kl.)  +  (VV  I  K'D). 

where  Juxtaposition  has  again  replaced  conjunclion  (a)  to  shorten  nota¬ 
tion. 

Sinee  K L\  KL  and  are  disjoint,  according  to  Leiniua  1.  we  can 
continue  with 

EiiX  I  KL')  +  iX  +  VV  I  KL\  +  (VV  |  K’ !.)) 

=  EiX  I  KL')BiKi:  I  K  V  L) 

+  EiX  +  VV  I  KL)BiKI.  I  K  v  L) 

(32)  4-  /:(VV  I  K'DPiK'L  \  K  V  L) 

=  EiX  I  KL')BiKL’  I  K  V  L) 

+  EiX  I  KL)BiKL  1  K  v  L) 

+  Ei\V  1  KDBiKL  I  K  V  L)) 

(33)  +  /:(VV  I  K’L)BiK'L  1  K  V  L) 

=  EiiX  I  KL')PiKL’  I  K)PiK  \  K  V  L) 

+  EiX  I  KDPiKL  I  K)PiK  I  K  v  L) 

4-  EiW  I  KL)PiKL  1  DPiL  \  K  v  L) 

(34)  +  /:(VV  I  K’DPiK'L  \  DPiL  \  K  v  L) 

=  [EiiX  1  KL’)PiKL’  I  K^ 

+  EiX  I  KDPiKL  I  K)\PiK  I  K  V  L) 

4-|/3(VV  1  KDPiKl.  I  D 

(35)  4-  EiW  I  K'L)PiK'l.  |  /.))/’(/.  |  X  V  /.) 

=  EiiX  I  KL')  +  (X  I  KD)PiK  \  K  v  L) 

(36)  4-  EiiW  1  KL)  +  (VV  |  K'L))PiL  \  K  V  L). 

using  Lemma  1  in  reverse.  So 

/:((X  I  x)-f  (VV  I  D) 

(37)  =  EiX  1  K)PiK  1  X  V  L)  +  EiW  \  L)PiL  \  K  v  /.). 
3'hat  is. 


/:((X  I  G  /i)  4-  (VV  I  Z  G  D)) 
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=  E{X  I  Y  €  B)P{Y  eB\Y  eBwZe  D) 

(38)  +  E{\Y  \  Z  €  l)))P{Z  e  D\Y  e  Bw  Z  e  D), 

Thai  completes  the  prool’  of  Theorem  1 .  □ 

THHOREM  2.  If  X,  Y,  IE  and  Z  are  real-vedned  random  variables  and 
B  and  I)  are  arbitrary  Borel  subsets  of  real  numbers,  then  the  expectation 
of  the  product  of  the  cotiditional  random  variables  (X  |  K  €  />’)  and 
(VE  \  Z  e  D)  is  ^iven  by 

E{{X  1  Y  e  B)  *  iW  I  Z  €  D)) 

=  E{X  \  Y  e  B  aZ  ^  D)P(Y  €  B  aZ  i  D\ 

Y  e  BwZe  D) 

+  E{X  *  VE  I  E  €  /i  A  Z  €  D)P{Y  e  B  AZe  D\ 

Y  e  By  Z  e  D) 

+  E{Z  \  Y  ^  B  aZ  e  D)PY  i  B  aZ  e  D  \ 

(39)  Y  e  Bv  Z  e  D). 

Proof  By  the  extended  dehnition  of  products, 

{X  \  Y  e  B)tAW  I  Z  €  D) 

X  if  Y  e  B  and  Z  ^  D, 

^  Lv  *  VE  if  E  e  B  and  Z  e  D, 

^  “I  »E  ifE  ^  B  and  Z  €  /), 

.  Undefined  if  E  ^  and  Z  ^  D, 

where  the  domain  of  the  produci  random  variable  has  been  broken  into  dis¬ 
joint  events.  Then  by  the  definition  of  the  eondilional  expectation  (Equa¬ 
tion  (25)),  the  expectation  of  this  product  random  variable,  E({X  |  E  e 
B)  *  (IE  I  Z  €  /))),  is  immediately  expressed  by  Equation  (39).  This 
eompletes  the  proof  of  Theorem  2.  □ 

With  a  kind  of  independence.  Equation  (39)  can  be  somewhat  simplified. 
Reeall  that  two  random  variables,  X  and  Z,  arc  independent  if  P{X  e 
A  and  Z  e  C)  =  P{X  e  A)P{Z  e  C)  for  any  events  X  e  A  and  Z  e  C. 
Knowing  the  value  taken  by  one  variable  does  not  change  the  probability 
of  the  other  variable  taking  its  values. 

DEEINITION  1  (Independence  of  Random  Variables),  Two  random  vari¬ 
ables  .Y  and  VE  are  independent  if  they  are  independent  on  eaeh  common 
domain.  That  is,  .Y  and  W  are  independent  if  for  any  event  II  for  which 


OPERATING  ON  FUNCTIONS  W1  Ill  VARIABLH  DOMAINS 


15 

both  X  and  W  arc  defined,  X  is  conditionally  independent  of  W  given  //. 
That  is  P{X  e  A  aW  eC  \  H)  =  P{X  e  A  \  H)P(\V  e  C  |  U). 

COROLLARY  TO  THEOREM  2.  If  X  am!  VT  air  imlepcmleui  rancloiii 
variables  then  under  the  hypothesis  ofTheoveiu  2, 

E{{X  \  Y  eB)^{W  \  Z  e  D)) 

=  E{X  \  Y  e  B  aZ  i  D)P{Y  e  B  aZ  i  D\ 

Y  e  B  V  Z  e  D) 

+  E{X  \YeBAZe  n)i:(\V  I 

Y  e  B  aZ  e  l))P{Y  e  B  aZ  e  D  \ 

Y  e  B  V  Z  e  D) 

-f  /::(iy  \YiBAZe  D)P{\Y  i  B  aZ  e  D  \ 

(41)  Y  e  By  Z  e  D). 

Proof  It  is  well  known  that  the  expectation  of  a  product  of  independent 
random  variables  is  the  product  of  the  exj^eetations.  Therefore  E{X  | 
Y  e  B  aZ  e  D)  =  E(X  \YeBAZe  D)E(W  \  Y  e  B  aZ  e  D).  and 
the  result  follows  by  substitution  into  Equation  (39).  □ 

EXAMPLE  1.  Consider  a  work  force  consisting  of  workers  /  =  1.2. 

....//  with  variable  work  output  levels  \Vi,  Wo . tuid  work  shifts 

.s'l ,  .V2 . V/i  respectively  spanning  the  24  hour  day.  To  fornudatc  the  predr* 

1cm  in  terms  of  random  variables,  let  A/(ct;)  =  I  if  time  a)  e  Si  and  0 
otherwise.  Then  the  work  level  at  time  co  of  worker  /  is  (W,  |  .v/(c<>)  =  I). 
T  he  sum  of  work  output  of  all  workers  is  i 

average  or  expected  work  level  over  the  day  is  t  =  I ))  ~ 

}Z,E(W:  \Siico)=  \)nsiico)=  1)). 

EXAMPLE  2.  Let  B  and  C  be  the  surveillance  regions  of  two  radars.  R I 
and  R2,  and  suppose  X{(v)  is  the  error  rale  of  missed  detections  by  Rl  at 
any  place  co  e  If  and  W{(o)  is  the  error  rate  by  1^2  at  any  place  co  e  C. 
X  and  W  are  undefined  outside  their  respeetive  domains  B  and  C.  'riicn 
using  the  definition  of  extended  product,  and  assuming  inde|)endencc  of 
detections  by  Rl  and  R2,  {X  *  W)(m)  =  ATc/;) \L(cf;)  is  the  combined  error 
rate  of  missed  detections  by  both  radars  over  (BUC).  This  ccanbined  ei  roi 
rate  is  X  on  B  H  C',  X  *  W  on  B  n  C,  and  W  on  IP  H  C. 

Now  suppose  in  addition  that  the  detection  rate  of  radar  Rl  is  grcatl\ 
affected  by  fog  F  while  interrogation  radar  R2  is  most  affected  by  the 
density  D  of  communication  on  interrogation  frequencies.  Measuring  log 
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as  "heavy  (li),  medium  (in),  or  none  (/;)”  and  communication  traffic  den¬ 
sity  on  a  scale  from  I  to  3,  the  error  rate  over  (/?  U  C)  under  conditions 
of  heavy  fog  and  communication  density  2  is  ((X  *  VK)  |  (F  =  h)  A 
(/)  =  2)  A  («  U  O)  =  ((X  *  If')  1  (F  =  /;)(/)  =  2)(B  U  C)).  So  the  ex¬ 
pected  combined  error  rate  of  the  two  radars  given  heavy  fog  and  medium 
(2)  communication  density  is  F((X  *  W)  |  (F  =  /()(D  =  2)(B  U  C)). 
Now  by  the  product  definition 

((X  *  HO  I  (F  =  li)iD  =  2){B  U  O) 

=  (X  I  (F  =  /!)(/)  =  2)BC')  V  (X  *  \y  1 

(42)  (F  =  li)(D  =  2)BC)  V  (VH  I  (F  =  h)(D  =  2)B'C). 

Since  the  detection  erroi  s  for  tlic  two  radars  are  assumed  independent,  tlie 
last  equation  simplilies  to 

i(X*W)  I  (F  =  /!)(/;  =  2)(/iUC)) 

=  (X  I  (F  =  li)BC')  V  (X  *  W  I 

(43)  (F  =  li)(D  =  2)BC)  V  (VH  |  (/)  =  2)B'C). 

Let  G  —  (F  =  li){l)  =  2)(  />  UCO-  Then  in  terms  of  the  average  error  rates 
of  the  individual  radars,  the  aventge  combined  error  rate  given  heavy  fog 
and  medium  (2)  communication  density  over  the  combined  surveillance 
region  (/>  U  C)  is 

F((X  MO  I  (F  =  /;)(/)  =  2)(B  U  C)) 

=  F(X  I  (F  =  li)BC'M\(F  =  li)BC')  \  G) 

-t-  F(X  *  W  I  (F  =  li)(D  =  2)BC)B((F  =  h)(D  =  2)BC  \ 

(44)  GO  -1-  F(IL  I  (/)  =  2)(BC'))P(n  =  2)B'C  \  G) 

=  F(X  I  (F  =  li){BC'))P((F  =  li){BC')  I  G) 

+  F(X  I  (F  =  li)(BC))Fi\V  1 

(I)  =  2)(FC))/’((F  =  li)(l)  =  2)(BC)  I  GO 

(45)  4-  F(M^  I  (/)  =  2)(B’C))P({D  =  2)(B'C)  \  G) 

using  conditional  independence  again  to  split  the  expectation  of  X*  M^  and 
to  simplify  the  conditions. 

For  simplicity,  assume  that  />’  U  C  is  the  whole  universe  and  that  fog 
is  heavy  (F  =  /i)  everywhere  and  communication  density  is  medium 
(D  =  2)  everywhere  in  FUC.  So  G  =  the  whole  universe  G),  and  P({F  = 
h)BC')  I  GO  =  P(BC).  Similarly,  F((F  =  h)(D  =  2)BC  \  G)  = 
P(BC)  and  P({D  =  2)(B'C)  ]  G)  =  P{B'C).  Thus 

F((X  *  MO  1  (F  =  li)(D  =  2)(B  U  C)) 
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=  I^ix  I  (/'  =/i)(/K:'))/^(/^c') 

+  E{X  I  {F  =  li){BC))EiW  I  {/)  =  2){BC))r(BC) 

(46)  +  F{W  I  (/)  =  2)(/i'C))/^(/rC). 

If  the  ei'i'or  rale  ol'  radar  R 1  is  0.04  in  lieavy  fog  ( F  =  h)  and  llic  error  rale 
of  R2  is  0.02  in  medium  commiinicalion  densily  {D  =  2).  the  combined 
error  rale  under  Ihe  condilions  is 

F{{X^\V)  I  (F  =  li)iD  =  2){BUC)) 

(47)  =  {{).04)F{BC')  +  (0.04)(0.()2)/^(/?r)  +  (0.02) /^(/i'C). 

Nole  Hull  ihe  error  rales  are  mulliplied  in  the  common  surveillance  region 
BC  where  Ihc  combined  error  rale  is  jiisl  O.OOOS. 


11.  Summary 

Hxlended  delinilions  of  funclion  addilion  and  other  operalions  have  been 
applied  lo  condilional  proposilions  and  conditional  events,  and  to  condi¬ 
tional  random  variables.  This  allows  direct  manipulation  of  conditional 
events  and  of  conditional  random  variables  without  resort  to  a  probability 
or  density  funetion.  General  formulas  for  the  expectation  of  the  sum,  and 
of  the  product,  of  two  conditional  random  variables  have  been  determined, 
b'inally  two  examples  illustrate  the  use  of  these  formulas  in  practical  situ¬ 
ations. 
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